ELECTRONIC MAIL SYSTEM AND METHOD FOR FORMING ELECTRONIC MAIL 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] The present application claims priority from Japanese Application Nos. 
2001^0077 filed February 16, 2001 and 2002-27387 filed February 4, 2002, the disclosures 
of \Artiich are hereby incorporated by reference herein. 

BACKGROUND OF THE INVENTION 

[0002] The present invention relates to a technique for forming document or 
electronic mail, espedally to a technique for forming document or electronic mail including 
multimedia information, in other words, contents such as images or voices. 
[0003] Through widespread communication networks typified by the Intemet, various 
kinds of people can exchange information between each other using electronic mail (e-mail). 
Using available Intemet e-mail techniques, one can send content such as an image or 
picture (including motion picture) or a voice, In other words, so-called "multimedia 
information," along with writing in text format. MIME (Multi-purpose Intemet Mail 
Extensions) is a well-known format in which multimedia information is attached with text 
information of e-mail. Now, in the foregoing description, the "content" may include text, 
voice, motion pictures, and still pictures, and data describing them. Furthermore, the 
"content" may include game data or Java Applets, both of which can be used to control a 
computer. 

[0004] However, inputting text data is a time-consuming operation for one who is not 
familiar with keyboard operations or kana-kanji conversion (front-end processing) operations. 
Furthemnore, in attaching content such as an image or voice, a certain level of skill of fomning 
the content or editing the content material is required for an operator. Trimming images, 
changing the resolution of images, changing the size of images, clipping sounds, and 
changing fbmnats for saving data, etc. are examples of editing. 

[0005] Consequently, it is difficult for the ordinary person to fonm an e-mail, especially 
to fomi and edit content as multimedia information and to fomi an e-mail having this content 
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attached. Furthermore, in order to utilize an image or sound that already exists, one should 
pay attention to copyright or right of portrait for this image or sound. And, finom a legal point of 
view, one cannot attach the image or the sound to an e-mail and send this e-mail without 
permission from the owner of the copyright for this image or sound. For example, attaching 
a photo image which is acquired from a web site on the Internet to an e-mail and sending 
this e-mail may be infringement of copyright of this photo image unless the owner of the 
copyright pennits utilization of this photo image. 

[0006] On the other hand, in traditional mail such as a pictorial postcard or various 
kinds of greeting cards (Christmas cards, birthday cards, etc.), all of which act as a traditional 
method of exchanging information, things associated with sending the mail, such as the 
situation of the sender based on a stamp on the mail, or a picture or selected design of the 
card, are sometimes more important than the content of the text. In other words, when 
information is exchanged through the pictorial card or the greeting card, communicating 
information on the situation of the sender (the sender is traveling, etc.) to the receiver is more 
important than the content of the text in many cases. 

[0007] If someone is going to produce the same effect using an e-mail as one gained 
from the traditional mail described above, attaching content as multimedia information is 
essential; the receiver can leam about the situation of the sender from the attached content 
more accurately than from an e-mail including text only. However, for the reason described 
above, it is difficult to attach content as multimedia infomnation to an e-mail. 
[0008] Therefore, it is an object of the present invention to provide a system for 
forming an e-mail easily, especially for attaching contents as multimedia information to the 
e-mail easily. 

SUMMARY OF THE INVENTION 

[0009] According to one aspect of the present invention, there is provided an 
electronic mail system, including a first storage unit operable to store a plurality of contents 
data; a second storage unit operable to store a mail template having a screen for forming an 
electronic mail and a layout of the contents data on the screen; and a controller operable to 
select a portion of the contents data in response to a user's input, to fomi an electronic mail 
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file with the portion of the contents data added thereto, and to form an electronic mail for 
displaying the saeen on a display with the portfon of the contents data arranged according to 
the mail template. 

[0010] It may be arranged that the mail template further includes a dialog screen 
relating to the contents data and answer options in the dialog saeen, and the controller may 
display the dialog screen on the display with the answer options arranged therein, form 
answer data In response to the user's input, and form the electronic mail file with the answer 
data added thereto. 

[0011] According to another aspect of the present invention, there is provided an 
electronic mail system, including a first storage unit operable to store second contents data 
relating to first contents data; a second storage unit operable to store a mail template having 
a screen for forming electronic mail and a layout of the second contents data on the screen; 
and a controller operable to form an electronic mail with a portion of the second contents 
data added thereto in accordance with the mail template based on a viewing of the first 
contents data by a user. 

[0012] Accorxling to another aspect of the present invention, there is provided a 
method for forming electronic mail having contents data added thereto, the method including 
loading a mail template having a screen for forming electronic mail and layout information of 
the contents data on the screen, the contents data being a target to be added thereto; 
displaying the contents data according to the screen and the layout infonnation; allowing a 
user to select any of the contente data; and forming an electronic mail file with the selected 
contents data added thereto. 

[0013] It may be ananged that the mail template fljrther includes a dialog screen 
relating to the contents data and answer options in the dialog screen, and the method for 
forming electronic mail may further include displaying the dialog screen with the answer 
options arranged thereon; allowing the user to select any of the answer options; and forming 
the electronic mail file with the selected answer options added thereto. 
[0014] According to another aspect of the present Invention, there Is provided a 
method for fomiing electronic mail having second contents data relating to first contents data 
added thereto, the method including loading a mail template having a screen for forming an 
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electronic mail and layout Information for the second contents data on the screen, the 
second contents data being a target to be added thereto based on a viewing of the first 
contents data by a user; and forming an electronic mail file with the second contents data 
added thereto in accordance with the mail template. 

[0015] According to another aspect of the present invention, there is provided a 
computer program for forming an electronic mail with contents data added thereto, the 
computer program controlling a data processing unit to perform the steps of loading a mail 
template having a screen for forming an electronic mail and layout infonmation for the 
contents data in the screen, the contents data being a target to be added thereto; displaying 
the contents data according to the screen and the layout information; allowing a user to 
select any of the contents data; and forming an electronic mail file with the selected contents 
data added thereto. 

[0016] It may be arranged that the mail template further includes a dialog saeen 
relating to the contents data and answer options in the dialog screen, the computer program 
controlling the data processing unit to perfomn the further steps of displaying the dialog 
screen with the answer options arranged thereon; allowing the user to select any of the 
answer options; and forming the electronic mail file with the selected answer options added 
thereto. 

[0017] According to another aspect of the present invention, there is provided a 
computer program for forming electronic mail having second contents data relating to first 
contents data added thereto, the computer program controlling a data processing unit to 
perform the steps of loading a mail template having a screen for forming an electronic mail 
and layout information for the second contents data in the screen, the second contents data 
being a target to be added thereto based on a viewing of the first contents data by a user; 
and forming an electronic mail file with the second contents data added thereto in 
accordance with the mail template. 

[0018] In the electronic mail system, the method for fomning electronic mail, and the 
computer program as described above, it may be arranged that the contents data includes at 
least one of text data, still picture data, motion picture data, and sound data. 
[0019] It may be arranged that the computer program as described above is provided 



in a computer-readable recording medium. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[00201 The present invention will be understood from the detailed description given 
hereafter, taken in conjunction with the accompanying drawings. 

[0021] Fig. 1 is a block diagram showing an overall structure of the electronic mail 
system according to the prefen^ed embodiment of the present invention. 
[0022] Fig. 2 is a block diagram of the terminal device according to the preferred 
embodiment of the present invention. 

[0023] Fig. 3 is a functional block diagram of the e-mail function in the terminal 
according to the preferred embodiment of the present invention. 

[0024] Fig. 4 is a flowchart showing a process of forming e-mails according to the 
preferred embodiment of the present invention. 

[0025] Fig. 5 to Fig. 9 are diagrams showing examples of images displayed on a 
saeen in the process of forming e-mails. 

DETAILED DESCRIPTION 

[0026] Now, a system according to a preferred embodiment of the present invention 
will be described with reference to the accompanying drawings. 

[0027] Fig. 1 is a block diagram showing an overall structure of the electronic mail 
system according to the preferred embodiment of the present invention. 
[0028 ] A contents distribution server 1 0 which distributes contents such as multimedia 
information, and a terminal device 20 which plays the contents for a user, are connected with 
each other via a networi< L, such as the Internet, etc. which an anonymous user can access. 
In the foregoing description, the networi< L acts such that a device connected with the 
networi< L can transmit information to and receive infomiation from a targeted device when a 
session is established between them. In Fig. 1. the ne1wori< L is illustrated in a simplified 
fashion, but, in fact, the configuration of the networi< L Is usually more complicated than the 
illustrated configuration. For example, the Internet consists of a plurality of nelwori^s 
combined with each other via gateway servers. The connection to the ne1wort< is not limited 
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to having a device connected witfi a iaacklaone network directly; the device can be connected 
to the network L temporarily, such as a PPP (Point to Point Protocol) connection, etc. to the 
extent that information can be transmitted to and received from the device when the session 
is established between the device and a server. In Fig. 1, a part of the network is illustrated 
as a single line, but, in fad, a plurality of communication lines may be connected with each 
other. 

[0029] The contents distribulion server 10 is a data processing device and can 
transmit data to and receive data from the terminal device 20 via the network L. The contents 
distribution server 10 includes a contents database (in the following description, database is 
referred to as DB) 1 1 in which contents are stored as digital data, an e-mail program DB 12 
storing a program (e-mail program) to achieve an e-mail function utilizing the stored contents, 
a licensed contents DB 13 in which contents such as pictures or music permitted or licensed 
to a user for distribution in the form of e-mail attachments (licensed contents) are stored, and 
a mail template DB 14 in which mail templates (e-mail templates) corresponding to contents 
are stored. 

[0030] In the contents DB 1 1 , contents such as a movie, music, or a video game, all of 
which are distributed from the contents distribution server 10, are stored as digital date. And, 
upon request of the temninal device 20 via the network L, the requested contents date are 
read from this contente DB 1 1 . 

[0031] In the e-mail program DB 12, the e-mail program for achieving the e-mail 
function customized in accordance with the contents stored in the contente DB 1 1 is stored. 
[0032] In the licensed contente DB 13, contente that are licensed to the user are 
stored. The licensed contente are, for example, a movie preview video, a publicity poster 
image, an image of a CD album jacket, or a voice comesponding to a part of music. The 
licensed contents are prepared for each of the contents stored in the contents DB 11 . 
[0033] In the mail template DB 14, mail templates are stored, each of which 
corresponds to each of the contente stored in the contente DB 1 1 . Mail templates are. for 
example, of a text-based fbmi, of a layout-based form, of a supplied contente (phrase, 
cut)-based fonn, or of a complete mail-based form. The mail template of a particular form is 
selected among these mail templates based on a decision of a contente distributor, and is 
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designated by a mail creation rule. This decision includes whether a questionnaire should 
be included or not. 

[0034] The mail template fomis a certain l<ind of antecedent of the final e-mail fomiat. 
That is to say, the mall template is comprised of a mail forniat and a control code. The mail 
format is a kind of language or mle that enables both the licensed content to be used and its 
layout representation to be displayed on different temninal devices equivalently. More 
specifically, the mail template can be implemented using XML (extensible Markup 
Language) and JAVA(Trademark). In this case, XML corresponds to the mail fomnat, and 
JAVA corresponds to the control code. But XML and JAVA are only examples of the mail 
format and the control code; another widely distributed structured language such as HTML 
(HyperText Markup Language) can be used as the mail fomnat, and another control code 
such as ActiveX, which an OS (Operating System) like Windows can interpret, can be used 
as the control code. 

[0035] In the case in which the content is a movie, the mail template corresponding to 
this content is comprised of inibmnation designating a location of the licensed contents 
(moving picture, still picture, sound, etc.) corresponding to this movie, informatfon on the 
layout of the licensed contents in the e-mail, examples of messages by which someone will 
become interested in the movie, such as a sales point of the movie or an impression of the 
movie, and information on the layout of the messages. 

[0036] Upon request of the terminal device 20, the contents distribution server 10 
distributes the requested contents, the e-mail program, the licensed contents and the mall 
templates corresponding to the requested contents fmm the databases described above to 
the requesting tenninal device 20. 

[0037] The terminal device 20 is a data processing device such as a personal 
computer or a entertainment system that is connected to the network L and can transmit 
data to and receive data from another temninal device or the contents distribution server 10. 
The terminal device 20 obtains the contents data from the contents distribution server 10 via 
the network L and plays back the obtained contents data for the user. 
[0038] Instead of obtaining the contents, the licensed contents, the e-mail program 
and the mail templates from the contents distribution sen/er 10, the terminal device 20 may 
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be equipped with a device for playing media, sucli as a CD (Compact Disc) or DVD (Digital 
Versatile Disc), and may obtain such data from the media. The contents, the e-mail 
program and the licensed contents corresponding to these contents, and the mail template 
customized for these contents may be recorded in the media. 

[0039] Furthermore, a website from which the e-mail program, the licensed contents 
or the mail template can be downloaded may be provided apart from the contents 
distribution server 10 described above. This website can transmit data to and receive data 
from the contents distribution sender 10 or the terminal device 20 via the network L. In such 
a case, the contents are so constructed that information on the location of these data on the 
network (for example, a URL (Uniform Resource Locator) or IP (Internet Protocol) address) 
can be obtained from the contents. 

[0040] In such website, a password or a key which can be obtained only by the user 
buying the contents officially may be set up. As a result, only the user officially buying the 
contents can utilize the website, fi^ described above, various patterns of distributing the 
e-mail program, the licensed contents and the mail templates exist, and any combination of 
the patterns of distribution meets the concept of the present invention. 
[0041] The terminal device 20 has the ability to form and send e-mail utilizing the 
contents by executing the e-mail program and the mail template obtained from the contents 
distribution server 1 0, various kinds of media or websites. Furthermore, the terminal device 
20 has the ability to receive e-mail with the contents attached and to play back these 
contents for the user. Thus, the user of the terminal device 20 can send or receive e-mail 
utilizing the contents. 

[0042] Fig. 2 is a block diagram of an example of a data processing device that can 
be utilized as the terminal device 20. This temainal device (data processing device) 20 has 
a function of playing media as well as being connectable to the network L, and is an 
entertainment device with which the user can play video games in addition to playing back 
video or sound. 

[0043] This terminal device 20 is equipped with two bus lines, a main bus line B1 and 
a sub bus line B2. These bus lines B1 and 82 may be connected with each other and 
detached from each other via a bus interface unit INT. 
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[0044] A main CPU 201, a main memory 202 comprising a RAM, a main DMAC 
(Direct Memory Access Controller) 203, an MPEG (Motion Picture Experts Group) decoder 
(MDEC) 204 and a GPU (Graphic Processing Unit) 205 having a built-in frame memory 206 
are connected with the main bus line B1 . A CRTC (CRT Controller) 207 that forms video 
output signals is connected with the GPU 205. 

[0045] The main CPU 201 loads a boot program from a ROM 21 1 on the sub bus line 
B2 via the bus interface unit INT at the startup of the temninal device 20 and executes this 
boot program to run an operating system of the terminal device 20. The main CPU 201 
controls a media drive 216 to load an application program, date etc. from a media 217 
mounted on the media drive, and stores this application program, etc. in the main memory 
202. Furthermore, the main CPU 201 executes geometry processing on a variety of data 
read out from the media, for example, date (coordinate values of the vertices (representative 
points) of a polygon, etc.) of a three-dimensional object comprising a plurality of fundamental 
figures (polygons). The main CPU 201 forms a display list, the content of which is 
information on defining polygons through this geometry processing. 
[0046 ] The infomiation on defining polygons is comprised of configuration information 
on the drawing area and polygon information. The configuration information on the drawing 
area is comprised of values of offset coordinates at an address of the frame buffer of the 
drawing area and values of coordinates of a drawing clipping area to cancel the drawing 
when the coordinates of the polygons are located out of the drawing area. The polygon 
information is comprised of polygon atfribute information and vertex information; the polygon 
attribute Information is information specifying shading mode, a-blending mode, texture 
mapping mode, bump mapping mode, etc., and the vertex information is infomnatioi on 
coordinates inside a vertex drawing area, coordinates inside a vertex texture area, a color of 
the vertex, etc. 

[0047 ] The GPU 205 holds a drawing context and reads out a corresponding drawing 
context based on identification infomiation on an image context which is included in a display 
list supplied by the main CPU 201. Furthermore, the GPU 205 executes rendering 
processing using this drawing context and draws a polygon on the fi^me memory 206. The 
frame memory 206 can be utilized as a texture memory. Therefore, pixel images on the 
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frame memory 206 can be mapped on a polygon to be drawn as a texture. 
[0048 ] The main DMAC 203 c»ntrols DMA (Direct Memory Access) data transfer for 
each circuit connected to the main bus line B1, and controls DMA date transfer for each 
circuit connected with the sub bus line B2 depending on the status of the bus interface unit 
INT. 

[0049] The MDEC 204 operates in parallel with the main CPU 201 and 
decompresses or decodes the contents date compressed according to the MPEG format or 
JPEG (Joint Photographic Experts Group) fomiat, etc. 

[0050] A sub CPU 208 comprising a microprocessor, etc., a sub memory 209 
comprising a RAM, a sub DMAC 210, a ROM 211 in which programs such as an operating 
system are stored, a sound processing unit (SPU) 212 which reads out sound data stored in 
the sound memory 213 and outputs this date as an audio output, a communication control 
unit (ATM) 214 which transmits infomiation to and receives information from an extemal 
device, such as the contents distribution sen/er 10, via the network L, an auxiliary storage 
unit 215 comprising a mass storage unit such as a hard disk unit, a media drive 216 for a 
media 217, such as a CD, DVD, etc. mounted thereon, and an input unit 218 are connected 
to the sub bus line B2. 

[0051] The sub CPU 208 executes a variety of operations according to the program 
recorded in the ROM 211. The sub DMAC 210 controls DMA data transfer, etc. for each 
circuit connected to the sub bus line 82 only when the main bus line 81 and the sub bus line 
82 are deteched from each other via the bus interface unit INT. 

[0052] The ATM 214 receives the contents, the e-mail program, etc. from the contents 
distribution server 10. The received contents may be played immediately and output as 
video output or audio output, or may be stored in the auxiliary storage unit 215. The input unit 
218 is comprised of a connection terminal 219 to which the input signals from an operating 
unit (controller) 220 are input. The user executes a variety of input operations using this 
operating unit 220. 

[0053] Fig. 3 is a functional block diagram of an e-mail function of the terminal device 
20. This function is formed in response to the execution of the e-mail program obteined 
from the contente distribution s&rv&r 10 (preferably from the e-mail program DB 12) or the 
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media 217. As shown in Fig. 3, the terminal device 20 is comprised of an infomiation 
receiving unit 230, a control unit 231, a display unit 232, an e-mail forming unit 233, a 
network interface unit 234, a system information storing unit 235, a licensed contents storing 
unit 236, a mail template storing unit 237, an e-mail analyzing unit 238, and a received mail 
storing unit 239. 

[0054] The e-mail program may be executed at any time, such as before playing 
contents, after playing contents, or during the playing of contents. 
[0055] For example, in order for the user viewing or hearing content to be able to 
send an e-mail corresponding to this content to another person (acquaintance, fi^iend, etc.) 
after playing the content, the terminal device 20 displays a question on a display of the 
terminal device 20 asking whether the user is going to fomi an e-mail. In this case, it is 
convenient for the user to display an e-mail forming screen on the display of the terminal 
device 20 in response to the user's decision to form an e-mail. 

[0056] Alternatively, the e-mail program may be booted automatically in response to 
an instruction by the content at a predetermined time, such as before playing the content, 
after playing the content, or during the playing of the content. Furthemnore, the e-mail 
program may be booted automatically by the operating system (OS) of the terminal device 
20 at a predetemiined time, such as before playing the content, after playing the content, or 
during the playing of the content. 

[0057] In response to the instruction to form the e-mail, the terminal device 20 obtains 
the e-mail program, the licensed content and the mail template, all of which correspond to 
the content, from the source of the content (the contents distribution server 10 or the media 
217) or from the websites which provide the e-mail program, the licensed content and the 
mail template described above. 

[0058 ] The information receiving unit 230 receives a variety of information Input by the 
operating unit 220. This information is necessary for forming the e-mail. The received 
information is sent to the control unit 231 . 

[0059] The control unit 231 controls a variety of operations based on information sent 
by the information receiving unit 230. For example, the control unit 231 controls the display 
unit 232 to show a predetermined image on the display, and sends the information 
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necessary for forming the e-mail to tfie e-mail forming unit 233. 

[0060 ] The displaying unit 232 shows images on the display of the terminal device 20 
in response to instructions from the control unit 231 . 

[0061] The e-mail fomiing unit 233 reads out the mail template from the mail template 
storing unit 237 in response to an instruction from the control unit 231, reads out the text, 
image, and sound, etc. from the licensed contents storing unit 236, and ioms a dialog 
screen for forming an e-mail based on these read-out data. The e-mail forming unit 233 
incorporates in the dialog saeen the necessary system information (present time, etc.) from 
the system infomnation storing unit 235. 

[0062 ] The network interface unit 234 sends the e-mail fomned by the e-mail forming 
unit 233 to the designated e-mail address via the network L. The network interface unit 234 
receives a variety of data described above from the content distribution server 10, websites, 
etc. and distributes these data to the e-mail forming unit 233. 

[0063] In the system inft)rmation storing unit 235, the system infomaatfon of the 
terminal device 20, a history of viewed contents, and personal infonnation (name, age, 
sexuality, address, etc.) of the user are stored. In the licensed contents storing unit 236, the 
licensed contents obtained from the source of the contents are stored. In the mail template 
storing unit 237, the mail template obtained from the source of the contents are stored. 
[0064] The e-mail analyzing unit 238 analyzes e-mail received from another tenninal 
device 20 via the networi< interface unit 234. The received e-mail is stored in the received 
mail storing unit 239. 

-Rrst Application - 

[0065] Using the contents distribution server 1 0 and the terminal device 20 described 
above, the user of the terminal device 20 can send and receive e-mail according to the 
procedure shown in the flowchart of Fig. 4. In this embodiment, an example is described in 
which the user views a movie as the content. 

[0066] In step SI 01 , the temainal device 20 obtains contents data of the movie from 
the contente distribution server 10 or the medium 217 and plays back the contents data. The 
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user can view the movie using the terminal device 20. In step S102, the temiinal device 20 
displays a question on the display of the temninal device 20 at or after the end of the movie 
asking whether the user wishes to form an e-mail utilizing the image or sound of this movie. 
If the detennination of step S102 is NO, in other words, the user does not wish to form an 
e-mail, the procedure ceases. 

[0067] On the other hand, if the determination of step S102 is YES, in other words, 
the user wishes to form an e-mail, the terminal device 20 loads the e-mail program from the 
contents distribution server 10 or the medium 217 and executes the e-mail program in step 
S103. Through this execution of the e-mail program, the functional blocks shown in Fig. 3 
are formed in the temiinal device 20. 

[0068] It is preferable that an official home page of the movie be set up in a website in 
the network L, and the e-mail program may be obtained from this website as well as from the 
contents distribution server 10 and the media 217. In the case that the e-mail program is 
obtained from the official home page, it is more preferable that a web address of the official 
home page, in other words, location information of the official home page in the network L 
such as a URL or IP address, be obtained along with the contents data of the movie. And it is 
more preferable that the terminal device 20 may automatically access the official home page 
and download the e-mail program in response to the user's command to form an e-mail. 
The licensed contents (cut of the promotion film, background music (BGM), and phrase of 
high point of soundtrack, etc.) corresponding to the movie and the mail template may also be 
disposed in the official home page, and in the case that these contents, etc. are disposed in 
the official home page, it is more preferable that the terminal device 20 may download these 
contents. 

[0069] The e-mail program loads a mail template corresponding to the movie 
(content) from the mail template storing unit 237 and executes the following process in 
accordance with the details of this mail template. 

[0070] Next, the control unit 231 controls the displaying unit 233 to display the screen 
shown in Fig. 5 on the display of the terminal device 20. In step SI 04, the user fills in each 
item on the screen using the operation unit 220 so as to input personal information of the 
user. In the example shown in Fig. 5, the name, sexuality, date of birth, zip code and 
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address of the user are to be input as personal information. If these kinds of information are 
stored in the system information recording unit 235 in advance, the control unit 231 
preferably loads and displays this information, and seeks confimnation from the user that 
these data can be utilized. 

[0071] After the user inputs the personal information, a screen as shown in Fig. 6 is 
displayed on the display of the terminal device 20. In step SI 05, the user fills out a 
questionnaire about the movie just played back by selecting from choices prepared for each 
item by means of the operation unit 220. In the example shown in Fig. 6, the user fills out the 
questionnaire by selecting from the choices on the screen by means of the operation unit 
220; thus, the user need not execute complicated operations to input the information. 
These items and the choices are provided as information by the distributor of the movie and 
embedded in the mail template, or are provided as one of the licensed contents. 
[0072] Next, a screen as shown in Fig. 7 is displayed on the display of the terminal 
device 20. In step SI 06, the user selects a licensed content corresponding to the movie 
just played back from the licensed contents displayed on the screen; thus, the licensed 
content utilized for or to t>e attached to the e-mail is selected. 

[0073] Described in more detail, the control unit 231 controls the displaying unit 232 to 
show a list of icons on the display of the terminal device 20, each of which corresponds to a 
licensed image or sound stored in the licensed contents storing unit 236. The user selects 
one icon corresponding to the user's favorite licensed content from these icons; thus, the 
licensed content utilized for or to be attached to the e-mail is selected. 
[0074] In the example shown in Fig. 7, three kinds of poster images, three kinds of 
scenes (motion picture) of the movie, and three kinds of BGM (music) are provided for the 
licensed contents, and the user may select one content for each category (poster image, 
scene, BGM). The control unit 231 controls the displaying unit 232 to show the icons on the 
display of the terminal device 20, each of which corresponds to one of the poster images, 
one of the scenes of the movie, and one of the kinds of BGM. The user selects one icon of 
a poster image, one icon of a scene of the movie, and one icon of a BGM by means of the 
operation unit 220. 

[0075] Next, a screen as shown in Fig. 8 is displayed on the display of the terminal 
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device 20. In step S107, the user selects a sentence to be used in the e-mail from a 
plurality of sentences displayed on the screen; thus, the sentence to be used in the e-mail is 
selected. 

[0076] Described in more detail, the control unit 231 controls the displaying unit 232 to 
show a list of example sentences on the display of the terminal device 20. In the example 
shown in Fig. 8, a plurality of sentences which praise the movie, or a plurality of sentences 
which lead the receiver of the e-mail to be tempted to see the movie, are prepared in the mail 
template as example sentences prepared by the distributor of the movie, and the user 
selects a sentence fr-om among these sentences. Displaying a plurality of example 
sentences in the style of pull-down menus for enabling the user to choose one example 
sentence, as shown in Fig. 8, is one example of a method for choosing a sentence, but it is 
understood that the method for choosing a sentence is not limited to the illustrated example. 
Another well-known method for choosing a sentence can be applied. In the example 
shown in Fig. 8, the user inputs the text of the e-mail by selecting firom example sentences 
on the screen by means of the operation unit 220; thus, the user need not execute 
complicated operations to input the Information. 

[0077] In this case, an address of the e-mail may be input by means of the operation 
unit 220, or may be selected from a list of addresses already stored in the system 
information storing unit 235. The method of selecting an address from the list of e-mail 
addresses is well known in the art, so a detailed explanation of this method will not be 
provided herein. But one example of this method is to display the list of addresses in the 
style of pull-down menus so that the user may select one address, as shown in Fig. 8. 
[0078] In step S108, the e-mail forming unit 233 edits the input and the selections 
described above and forms the e-mail. The control unit 231 sends infonnation indicating 
the selected licensed content and infomnation indicating the selected example sentence to 
the e-mail forming unit 233. The e-mail forming unit 233 loads the corresponding licensed 
content and the sentence from the licensed contents storing unit 236 and the e-mail template 
storing unit 237 based on this information and inserts them into their predetermined positions 
in the mail format of the selected mail template. Moreover, the e-mail fomning unit 233 loads 
information on the present time and date from the system information recording unit 235 and 
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inserts this information into its predetermined position in tine mail format. The e-mail is 
fornied in this manner. 

[0079] The mail template defines the procedure of forming the e-mail and the control 
procedure of displaying the screens as described above. For this reason, the mail template 
is prepared for each content. 

[0080] The finished e-mail is sent from the e-mail fomiing unit 233 to the control unit 
231 , and the displaying unit 232 displays the finished e-mail on a screen of the display of the 
terminal device 20. The finished e-mail is, for example, as shown in Fig. 9. The user checks 
the finished e-mail, and if the user decides to send this e-mail, he or she selects the "send" 
button on the screen, as shown in Fig. 9. When the "send" button is selected, in other 
words, the detemiination of step S109 is YES, the e-mail forming unit 233 sends the e-mail 
via the network interface unit 234 in step S1 10. 

[0081] It is preferred that the terminal device 20 be able to send the answer data for 
the questionnaire input by the user during the process of forming the e-mail to tiie contents 
distribution server 1 0 or another server (the server of the movie distributor). In fliis way, the 
movie distributor can collect the user's impression of the movie, etc. automatically. 
[0082 ] On the other hand, if the user decides not to send the e-mail, he or she selects 
the "cancel" button on the screen, as shown in Fig. 9. When the "cancel" button is selected, 
in other words, the detemnination of step SI 09 is NO, the e-mail forming program ceases the 
procedure in step 1 1 1 without sending the e-mail. 

[0083] The instruction of sending the e-mail or canceling the e-mail described above 
may be given by \he user's operBtion of a button in tiie terminal device 20 or tine operation 
unit 220. 

[0084 ] Meanwhile, the button displayed on tiie upper right of the screen shown in Fig. 
9 is an order button with a discount credit. A user receiving the e-mail is capable of buying 
ttie movie content discounted by 50%. More particularly, an order processing program 
invoked in response to selection of this button is embedded in the e-mail. When the user 
selects the button after receiving the e-mail, the above-mentioned order processing program 
runs on the terminal device 20 and accesses a contents selling sen/er on the network. As a 
result, ordering of movie contents, etc. and payment can be achieved. Alternatively, tiie 
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order button with the discount credit links to the URL of the above-mentioned contents selling 
server, and the terminal device 20 may accesses this URL in response to the selection of the 

button by the user. 

£0085] As described above, according to the preferred embodiment, the user can 
form an e-mail comprising text, images and sound by making selections through the use of 
the operation unit 220 while minimizing complicated input operations as much as possible. 
The user can easily form the e-mail with multimedia information attached without spedal 
knowledge or experience about multimedia technology. Furthermore, the user can share 
the user's impression of the movie (information on the situation of the user at the time) with 
another person by an e-mail utilizing a picture or BGM of the movie. 

- Second Application - 

[0086] The present invention may be applied to a case in which a video game is 
utilized as content. 

[0087] In the video game, especially in an RPG (Role Playing Game), a variety of 
events are carried out in accordance with the start of the game. The events are, for 
example, the input of a character at the start of the game, shopping in a town in the game 
space, an exploration, etc. In this case, a mail template that forms e-mail corresponding to 
the progress of the game is preferable. 

[0088] In the progress of the video game, infomnation about the game (situation 
infomiation), such as the history of the game varying according to the progress of the game 
or a score of the game at the time, is recorded in the system information storing unit 235. In 
response to an instruction from the user to form an e-mail, the control unit 231 loads the mail 
template available at the moment from the mail template storing unit 237 with reference to 
the situation information in the system information storing unit 235, and controls the display 
unit 232 to display an e-mail forming screen on the display of the terminal device 20 based 
on the situation information at the moment. As in the first embodiment, the user selects his 
or her favorite licensed content or example sentence firom the licensed contents or example 
sentences defined in the mail template. The e-mail is formed using the selected licensed 
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contents and example sentence. For example, licensed contents and the example 
sentences are provided which are suitable for a situation or stage in accordance with the 
progress of the game. The stage is, for example, as described below: 

(1) Start of the game 

[0089] A history of purchase, an opening cut, the name of a selected character, the 
image of the character, configuration information about an organized team, and licensed 
contents such as pictures are provided in the mail template to notify the user's friend that the 
game has been purchased. 

(2) During the progress of the game (Part 1 ) 

[0090] A history of the game, a situation of the game (a situation of the team, etc.), 
information about a checkpoint character, licensed content such as a cut of a checkpoint 
event, a picture (pictorial postcard) of an unexplored territory event, or a hint for playing the 
game are provided in the mail template to notify another person of the stage of progress of 
the game. 

(3) During the progress of the game (Part 2) 

[0091] The score of the game, licensed contents such as tool data for the game, or 
item data are provided in the mail template for exchanging game information or giving the 
present values in the game to the user's friend playing the same game, 

(4) During the progress of the game (Part 3) 

[0092] An order list of real products, an order confirmation, an acknowledgment, an 
address for delivering the products, licensed content such as a letter attached to the product 
to be delivered are provided in the mail template for the game distributor or an affiliate 
company in order to handle to the order of products related to the game. 

(5) After the finish of the game 

[0093] The history of the game, licensed contents such as a memory event, hints for 
playing the game, or the impression of the game are provided in the mail template for 
sharing the user's impression of the game with the user's friend. 

[0094] As described above, the user can share the user's experiences with another 
person in the same manner as a pictorial postcard by using an e-mail at every stage. 
Furthermore, these e-mails can be advertisements for the game. 



18 



[0095] Moreover, as described above, the user can send an e-mail to the distributor of 
the game or to another player with the real-time experiences of the user attached. 
[0096] For example, the user who asks for hints for playing the game in order to 
proceed to the next stage can send an inquiry e-mail to the distributor of the game as he or 
she plays the game. The distributor of the game who receives the inquiry e-mail can refer 
to the real-time experiences of the user attached to the e-mail, so that the distributor of the 
game can give the user an appropriate hint (a hint which does not disturtD the progress and 
direcfion of the game wtiile meeting the user's request) while preventing careless exposure 
of infomnation. 

[0097] Furthermore, the user can make a successful communication with another 
player about the game via an e-mail. In the second embodiment described above, an 
example applied to an RPG is explained in detail. However, the second embodiment can 
be applied not only to an RPG, but also to a variety of game such as an action game or 
simulation game. Preferably, the second embodiment may be applied to a game in which 
the history of the game formed in accordance with the progress of the game has some kind 
of meaning or value for the user. 

- Third Application - 

[0098] The present invention may be applied to a case in which a map or sightseeing 
database is used as content. 

[0099] In a car navigation system or in a configuration where a mobile information 
terminal such as a mobile phone is equipped with a small peripheral memory unit, location 
information acquired by the car navigation system or the mobile information terminal can be 
stored or recorded in a memory unit in the car navigation system or the peripheral memory 
unit. Such location infonnation acquired by the mobile information tenninal, etc. is important 
data indicating the movement of the user. Consequently, it is preferable for the tenninal 
device 20 to control the peripheral memory unit, the car navigation system or the mobile 
information terminal to transfer such location information as described above to the tenninai 
device 20, and to identify the path of the user's movement on a map or sightseeing database. 
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Thus, it is possible to form an e-mail in which plenty of data of visited places are incorporated 
by searching sightseeing data in the map or sightseeing database based on the path of the 
user's movement. The map or sightseeing database means a database that provides a map 
image to be displayed indicating an area in response to the destination name, station name, 
landmark name, or longitude or latitude information, and that provides information relating to 
the sightseeing spots located in the area. 

[0100] For example, when the user visits Kamakura (location name), a mail template 
is provided that searches or selects the map content in which the travel route of the user is 
displayed, along with the photo content and caption content of the famous places or 
historical spots which the user stopped by on the way using the map or sightseeing database 
based on the location information, and that forms an e-mail having the selected map content, 
etc. attached. Therefore, the user can easily form an e-mail providing notice of the user's 
travel, to which the route map and the photos in various places are attached. 
[0101] While the present invention has been described in terms of the preferred 
embodiments and the modifications thereof, the invention is not to be limited thereto, but can 
be embodied in various ways vwthout departing from the principle of the invention as defined 
in the appended claims. For example, it is not necessary that each server in the preferred 
embodiment described above be comprised of a single data processing unit; each server 
may be comprised of a plurality of data processing units which cooperate with each other 
and execute a predetermined data processing method. 

[0102] As described above, according to the present invention, the user can form an 
e-mail which is comprised of text selected from example sentences and the pictures or the 
sounds of licensed content using an e-mail program corresponding to the content as 
multimedia information, as well as playing the content, and can send this e-mail to another 
user. Consequently, the user can form an e-mail with high quality data attached which 
reflects the real-time situation at the time of utilizing the content by a simple selecting 
operation, without using a complex editing system. Therefore, it is easy to transmit the 
user's intention or situation data. 

[0103] Moreover, the distributor of the contents can obtain so-called word-of-mouth 
advertisement and can control the detail and the format of the contents to be distributed at 
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the distributor's side. Therefore, the present invention supplies an incentive to the distributor 
of the contents to provide high-quality contents data and to license the contents easily. 
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